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Research  Goals 

To  understand  and  quantify  light  scattering  from  ensembles  of  irregularly-shaped 
objects.  To  characterize  the  effect  of  ensembles  of  micro-organisms  on  the 
propagation  of  polarized  light  through  sea  water.  To  determine  the  feasibility  of 
detecting  particle  orientation  and  to  assess  the  importance  of  scattering  to 
underwater  imaging  techniques  and  irradiance  calculations. 

Objectives 

To  develop  a  numerical  or  analytical  model  that  predicts  angle-dependent 
scattering  of  polarized  light  from  ensembles  of  non-spherical  marine  organisms, 
detritus,  and  inorganic  particulates.  To  verify  and  examine  the  validity  and  range 
of  applications  of  the  model  by  comparison  with  exact  calculations  and/or 
experimental  results  as  appropriate.  Specific  tasks  toward  the  objectives  are:  (1)  to 
develop  an  artificial  neural  network  to  recognize  features  in  the  scattering  matrix 
elements  associated  with  the  irregular  shape  of  oceanic  scatterers,  and  (2)  to  refine 
and  enhance  the  coupled-dipole  approximation  method. 

Approach 

In  past  reporting  periods,  our  efforts  to  understand  and  quantify  light  scattering  in 
the  ocean  have  been  concentrated  on  the  calculation  of  the  Mueller  scattering 
matrix  from  optical  properties  of  the  scattering  medium.  In  this  approach,  the 
polarization  states  of  the  incident  and  scattered  light  are  described  by  four-element 
Stokes  vectors  and  the  effect  of  the  scattering  medium  on  the  incident  beam  is 
described  by  the  sixteen-element  Mueller  or  scattering  matrix.  The  Mueller  matrix 
for  a  given  medium  contains  all  the  information  on  optical  properties,  size 
parameter,  and  shape  of  the  particles  that  make  up  the  scattering  medium.  The 
Mueller  matrix  for  light  scattering  by  spherical  particles  is  generally  determined  by 
Mie  calculations,  but  for  irregularly-shaped  particles,  it  must  be  determined  from 
an  approximation  method  such  as  the  coupled-dipole  approximation.  h2 


The  effort  during  the  current  reporting  period  has  been  focused  on  the  inverse 
problem.  That  is,  given  the  experimental  values  of  the  Mueller  matrix  elements, 
what  are  the  optical  properties,  size  parameter,  and  shape  of  the  particles  that 
scatter  the  light?  This  information  is  contained  in  the  Mueller  Matrix,  but  it  is 
not  a  simple  task  to  retrieve  it.  The  pattern  recognition  and  classification 
properties  of  an  artificial  neural  network  offer  a  unique  approach  to  retrieving  the 
information.  An  artificial  neural  network  that  could  accomplish  this  task  must  be 
capable  of  distinguishing  the  features  of  light  scattering  due  to  particle  size  from 
those  due  to  index  of  refraction  or  particle  shape. 

An  artificial  neural  network  is  a  number  computing  elements  connected  in 
parallel.  Despite  its  provocative  name,  the  artificial  neural  network  does  not 
necessarily  mimic  a  network  of  biological  neurons.  It  is  a  computing  system  made 
up  of  a  number  of  simple,  interconnected  processing  elements,  sometimes  called 
neurons  or  nodes,  operating  in  parallel.  The  network  may  be  'hard-wired' 
(constructed  of  electronic  components)  or  created  by  a  computer  simulation.  The 
artificial  neural  network  described  in  this  report  is  a  computer  simulation  using  a 
Power  Macintosh  desk  computer. 

A  given  neuron  (node)  may  have  any  number  of  inputs  but  it  has  only  one 
output.  Each  input  value  to  the  neuron  is  given  a  weight.  In  the  neuron  or 
node,  each  value  is  multiplied  by  its  corresponding  weight  and  the  results  are 
summed  over  all  of  the  input  values.  The  result  of  the  computation  (a  single 
number)  is  then  passed  to  a  transfer  function.  The  transfer  function  may  contain 
a  bias  that  adds  a  degree  of  freedom  in  training  the  network.  Several  different 
types  of  transfer  functions  are  used  in  neural  network  architecture.  For  example, 
the  transfer  function  may  restrict  the  output  of  the  neuron  to  be  either  a  zero  or  a 
one  (hard-limit  function),  or  a  number  ranging  between  zero  and  one  (log- 
sigmoid  function),  or  just  a  number  proportional  to  the  input  number  (linear 
function). 

A  number  of  identical  processing  elements  functioning  in  parallel  constitute  a 
layer.  The  layer  that  receives  inputs  is  called  the  input  layer.  It  performs  no 
function  other  than  buffering  the  input  signal.  "The  network  outputs  are 
generated  from  the  output  layer.  A  layers  whose  outputs  are  passed  to  the  next 
layer  is  called  a  hidden  layer.  The  network  is  fully  connected  if  every  output  from 
one  layer  is  passed  along  to  every  node  in  the  next  layer.  When  weight 
adjustments  are  made  in  preceding  layers  of  feed  forward  networks  by  "backing 
up"  from  outputs,  the  term  back  propagation  is  used.  The  back  propagation  allows 
for  the  training  of  a  network  to  produce  the  correct  output.  The  architecture  of  the 
artificial  neural  network  we  have  selected  for  our  light  scattering  analysis  is  a  fully 
cormected,  2  hidden-layer,  back  propagation  neural  network. 

The  initial  approach  to  developing  the  desired  neural  net  was  to  target  one 
property  of  a  scatterer,  its  size  parameter.  The  size  parameter  is  defined  to  be  equal 

to  2nr/X,  where  r  is  the  radius  of  the  spherical  particle  and  X  is  the  wavelength  of 


the  incident  light  in  the  medium.  For  non-spherical  particles,  r  is  taken  to  be  the 
radius  of  a  sphere  of  equivalent  volume.  The  Mueller  matrix  element,  S34,  has 
been  used  to  predict  the  sizes  of  bacteria,^  so  it  seemed  to  be  a  good  candidate  for 
the  input  to  the  network.  If  the  network  is  given  the  S34  matrix  element  as  a 
function  of  scattering  angle,  can  it  determine  the  size  parameter  of  the  scattering 
particles?  In  order  to  construct  a  network  that  could  be  evaluated  for  different 
learning  strategies  and  error  determination  methods,  it  was  important  to  keep  the 
number  of  input  data  points  as  small  as  possible  so  that  the  calculations  could  be 
carried  out  on  a  Macintosh  computer.  It  has  been  shown  that  at  least  3  or  4 
processing  elements  for  each  input  node  (data  point)  is  required  for  a  network  to 
have  sufficient  power  to  solve  a  problem  of  this  type.4/5  Fortunately,  examination 
of  the  S34  matrix  element  calculated  from  Mie  theory  indicated  that  it  could  be 
duplicated  extremely  well  with  a  Fourier  series  of  as  few  as  eight  terms  for  size 
parameters  up  to  about  ten.  Therefore,  as  much  useful  information  about  the 
functional  form  of  S34  could  be  supplied  to  the  network  using  the  eight  Fourier 
coefficients  as  with  using  forty  or  fifty  data  points.  Instead  of  one  or  two  hundred 
processing  elements,  a  trainable  network  with  as  few  as  24  processing  elements 
was  feasible.  The  final  network  design  is  similar  that  shown  in  Figure  1.  The 
network  has  eight  input  nodes  (the  Fourier  coefficients)  and  one  output  node  (the 
size  parameter.)  The  first  hidden  layer  has  32  nodes  and  the  second  hidden  layer 
has  6  nodes.  The  output  layer  has  a  linear  transfer  function  (F3  with  a  bias  b3)  and 
the  two  hidden  layers  both  have  log-sigmoid  transfer  functions  (FI  and  F2  with 
bias  bl  and  b2,  respectively).  Computations  such  as  selection  of  initial  weight 
matrices,  summing  weighted  inputs  (matrix  inner  product),  calculations  of  the 
transfer  functions,  applying  learning  rules,  and  assessing  the  network's  learning 
rate  and  performance  were  carried  out  using  algorithms  in  the  MATLAB  library 
and  its  associated  Neural  Network  Toolbox.^  (MATLAB  is  a  registered  trademark 
of  The  Math  Works,  Inc.) 

Tasks  Completed 

The  design  and  initial  training  of  an  artificial  neural  network  that  predicts  the  size 
parameter  of  a  light  scatterer  given  its  S34  matrix  element  was  completed.  As  an 
alternative  to  experimental  data,  the  network  was  trained  and  tested  for  both 
spherical  and  irregularly-shaped  particles  using  Mie  calculations  and  calculations 
made  with  the  coupled-dipole  model.  The  important  features  of  a  network  are 
illustrated  with  this  simple  version.  A  more  extensive  network  that  predicts 
optical  properties  and  shape  factors,  as  well  as  size  parameter,  has  also  been 
designed.  It  does  not  differ  in  basic  features  from  the  simpler  one,  although  it 
requires  more  input  data  and  many  more  neurons  to  produce  the  desired  results. 
We  have  shown  that  Mie  and  coupled-dipole  calculations  can  provide  a  workable 
data  set  for  training  a  neural  network.  However,  it  is  important  to  test  the 
network  with  experimental  data.  For  this  reason,  future  plans  for  this  project 
include  an  experimental  component  at  TSU  to  supplement  the  experimental 
work  of  Hunt  and  Quinby-Hunt  at  LBL. 


During  the  summer  of  1995,  the  Principal  Investigator  worked  with  Arlon  Hunt 
and  Mary  Quinby-Hunt  at  Lawrence  Berkeley  Laboratory.  During  this  time,  work 
was  completed  on  a  nebulizer  system  to  produce  aerosols  similar  to  those  found 
in  the  marine  boundary  layer.  Angular-dependent  Mueller  matrix  elements  for 
the  light  scattered  by  these  aerosols  were  measured  by  Quinby-Hunt  using  the 
polarization-modulated  nephelometer.  In  addition  to  the  obvious  value  of 
experimental  measurements  in  understanding  the  marine  boundary  layer 
directly,  the  measurements  also  serve  as  a  data  base  to  train  and  test  the  capability 
of  the  artificial  neural  network. 


Input  Hidden  Layer  1  Hidden  Layer  2  Output 


Figure  1.  A  multi-layer  artificial  neural  network.  The  network  shown  is  fully  connected.  There 
are  n  inputs  values,  k  processing  elements  (nodes)  in  the  first  hidden  layer,  two  nodes  in  the 
second  hidden  layer  to  distribute  error,  and  one  output  node. 


Scientific  Results 

The  original  neural  network  was  trained  using  a  'clean'  data  set  determined  from 
Mie  theory.  That  is,  the  S34  matrix  elements  were  calculated  for  a  single  sphere 
with  a  fixed  index  of  refraction  for  size  parameters  ranging  from  one  to  ten.  Size 
parameters  less  than  one  were  not  considered  in  the  calculations  since  they  are 
approaching  the  Rayleigh  limit.  Light  scattering  is  not  a  function  of  particle  size 
or  shape  in  this  limit.  A  'clean'  data  set  having  a  size  parameter  between  two 
values  in  the  original  test  set  was  presented  to  the  network  for  analysis.  The  size 
parameter  could  be  identified  to  within  1%,  illustrating  a  neural  network's  ability 
to  interpolate  or  generalize  results. 

Unlike  calculated  data,  experimental  data  are  often  'noisy.'  In  addition  to  the 
electronic  noise  in  the  instrument,  the  effects  of  scattering  samples  made  up  of  a 
mixture  of  particles  of  different  sizes,  shapes  and  refractive  indices  contribute  to 


the  'noise'  in  the  data.  A  reasonable  evaluation  of  a  neural  net  cannot  be  made 
without  taking  into  account  'noisy'  input  data.  In  order  to  simulate  the  features 
of  experimental  data,  Mie  calculations  were  made  for  a  Gaussian  distribution  of 
spheres  with  varying  indices  of  refraction  and  coupled-dipole  calculations  with 
orientational  averaging  were  made  for  ellipsoids,  cubes  and  cylinders  for  different 
size  parameters  and  index  of  refraction.  The  resulting  S34  matrix  elements  are 
shown  as  a  function  of  scattering  angle  for  particles  of  different  size  parameters, 
indices  of  refraction  and  shape  in  Figure  2.  The  figure  clearly  shows  why  S34  was 
chosen  as  a  predictor  of  size  parameter.  Figures  2(a)  and  2(b)  illustrate  the  strong 
dependence  of  S34  on  size  parameter.  The  index  of  refraction  is  kept  constant  in 
both  (a)  and  (b).  Figure  2(a)  also  shows  how  rapidly  S34  goes  to  zero  in  the 
Rayleigh  limit.  Figure  2(c)  depicts  the  change  in  S34  as  the  index  of  refraction  is 
changed  while  keeping  the  size  parameter  fixed.  Finally,  Figure  2(d)  illustrates 
differences  that  might  be  expected  in  S34  for  particles  of  different  shapes. 

The  'noisy'  data  (different  shapes  and  relative  refractive  index)  shown  in  Figure  2 
were  presented  to  the  network  to  test  the  network's  ability  to  distinguish  size 
parameter  from  shape  and  index  of  refraction  variations.  It  was  necessary  to  train 
a  second  version  of  the  neural  net  to  be  insensitive  to  the  variations  in  S34  due  to 
index  of  refraction.  This  was  accomplished  by  including  S34's  calculated  for 
different  indices  of  refraction  in  the  training  set.  The  new  network  could  predict 
the  correct  size  parameter  for  different  indices  of  refraction,  generally  to  within 
10%.  The  network  could  also  correctly  identify  size  parameter  for  cubes  as  well  as 
spheres,  but  in  identifying  the  size  parameter  for  ellipsoids  and  cylinders  the  error 
was  very  large  (greater  than  30%).  The  number  of  training  sets  and/or  the 
number  of  neurons  can  be  increased  to  improve  the  network's  performance,  or 
other  matrix  elements  (Sll,  S12  and  S33)  can  be  used  as  training  as  testing  data. 

Accomplishments 

The  artificial  neural  network  is  a  unique  and  powerful  tool  that  is  being  applied  to 
large  classes  of  problems.  The  tasks  that  the  networks  are  performing  in  both 
science  and  industry  form  an  impressive  list.  In  our  inverse  problem  approach,  a 
simple  artificial  neural  network  has  been  designed  and  tested  that  predicts  the  size 
parameter  of  a  scatterer  based  on  its  S34  matrix  element.  The  success  of  this 
simple  network  is  an  important  first  step  in  our  goal  of  predicting  the  optical 
properties,  size  parameter,  and  shape  of  the  particles  that  make  up  the  scattering 
medium  from  experimental  measurements  of  light  scattering.  Furthermore,  the 
experience  we  have  gained  in  designing,  training  and  testing  a  neural  network  has 
given  us  insight  into  its  potential  applications.  For  example,  existing  light¬ 
scattering  instruments  could  easily  be  modified  to  include  a  software  version  or  a 
'hard-wired'  electronic  version  of  a  neural  network  for  particle  sizing. 
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Figure  2.  The  Mueller  matrix  element,  S34  as  a  function  of  scattering  angle,  (a)  and  (b)  show 
S34  for  spheres  of  various  size  parameters,  (c)  shows  the  variation  of  S34  for  spheres  with 
relative  index  of  refractive  for  a  constant  size  parameter,  and  (d)  illustrates  the  effects  of 
particle  shape  on  S34.  In  all  figures  other  than  (c)  the  relative  index  of  refraction  of  the 
scattering  particles  is  kept  constant  at  1 . 1 1 . 
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